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METHOD AND APPARATUS FOR COUNTING EXECUTION OF SPECIFIC 
INSTRUCTIONS AND ACCESSES TO SPECIFIC DATA LOCATIONS 

CROSS REFERENCE TO RELATED APPLICATIONS 

The present invention is related to the following 
applications entitled "Method and Apparatus for Counting 
instruction Execution and Data Accesses", serial no. 

, attorney docket no. AUS920030477US1; "Method 

and Apparatus for Selectively Counting Instructions and 

Data Accesses", serial no . attorney docket 

no. AUS920030478US1; "Method and Apparatus for Generating 
interrupts Upon Execution of Marked Instructions and Upon 
Access to Marked Memory Locations", serial no. 

, attorney docket no. AUS920030479US1 ; "Method 

and Apparatus for Counting Data Accesses and Instruction 
Executions that Exceed a Threshold", serial no. 

, attorney docket no. AUS920030480US1 ; "Method 

and Apparatus for Debug Support for Individual 
Instructions and Memory Locations", serial no. 

_, attorney docket no. AUS920030482US1 ; "Method 

and Apparatus to Autonomically Select Instructions for 

Selective Counting", serial no. attorney 

docket no. AUS920030483US1; "Method and Apparatus to 
Autonomically Count Instruction Execution for 

n „~ attorney docket no. 

Applications", serial no. • acuoxi y 

AUS920030484US1; "Method and Apparatus to Autonomically 
Take an Exception on Specified Instructions", serial no. 

, attorney docket no. AUS920030485US1 ; "Method 

and Apparatus to Autonomically Profile Applications", 
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serial no. , attorney docket no. 

AUS920030486US1; and "Method and Apparatus for Counting 
instruction and Memory Location Ranges", serial no. 

, attorney docket no. AUS920030487US1 filed 

even date hereof, assigned to the same assignee, and 
incorporated herein by reference. 

BACKGROUND OP THE INVENTION 



1. Technical Field: 

The present invention relates generally to an 
improved data processing system. In particular, the 
present invention provides a method and apparatus for 
obtaining performance data in a data processing system. 
Still more particularly, the present invention provides a 
method and apparatus for hardware assistance to software 
tools in obtaining performance data in a data processing 
system. 

2. Description of Related Art: 

in analyzing and enhancing performance of a data 
processing system and the applications executing within 
the data processing system, it is helpful to know which 
software modules within a data processing system are 
using system resources. Effective management and 
enhancement of data processing systems requires knowing 
how and when various system resources are being used. 
Performance tools are used to monitor and examine a data 
processing system to determine resource consumption as 
various software applications are executing within the 
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data processing system. For example, a performance tool 
may identify the most frequently executed modules and 
instructions in a data processing system, or may identify 
those modules which allocate the largest amount of memory 
or perform the most I/O requests. Hardware performance 
tools may be built into the system or added at a later 

point in time. 

One known software performance tool is a trace tool. 
A trace tool may use more than one technique to provide 
trace information that indicates execution flows for an 
executing program. One technique keeps track of 
particular sequences of instructions by logging certain 
events as they occur, a so-called event-based profiling 
technique. For example, a trace tool may log every entry 
into, and every exit from, a module, subroutine, method, 
function, or system component. Alternately, a trace tool 
may log the requestor and the amounts of memory allocated 
for each memory allocation request. Typically, a time- 
stamped record is produced for each such event. 
Corresponding pairs of records, similar to entry-exit 
records, also are used to trace execution of arbitrary 
code segments, starting and completing I/O or data 
transmission, and for many other events of interest. 

in order to improve performance of code generated by 
various families of computers, it is often necessary to 
determine where time is being spent by the processor xn 
executing code, such efforts being commonly known in the 
computer processing arts as locating "hot spots". 
Ideally, one would like to isolate such hot spots at the 
instruction and/or source line of code level in order to 
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focus attention on areas which might benefit most from 
improvements to the code. 

Another trace technique involves periodically 
sampling a program's execution flows to identify certain 
locations in the program in which the program appears to 
spend large amounts of time. This technique is based on 
the idea of periodically interrupting the application or 
data processing system execution at regular intervals, 
so-called sample-based profiling. At each interruption, 
information is recorded for a predetermined length of 
time or for a predetermined number of events of interest. 
For example, the program counter of the currently 
executing thread, which is an executable portion of the 
larger program being profiled, may be recorded during the 
intervals. These values may be resolved against a load 
map and symbol table information for the data processing 
system at post-processing time, and a profile of where 
the time is being spent may be obtained from this 
analysis . 

Creating tools such as these to find answers related 
to specific situations or problems can take much effort 
and can be very difficult to calibrate as the software 
tools themselves affect the system under test. The 
present invention recognizes that hardware assistance for 
tool development and problem analysis can significantly 
ease the amount of effort needed to develop software 
performance tools. Further, with the increasing density 
of processors, hardware assistance can be included to 
provide additional debug and analysis features. 
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Therefore, it would be advantageous to have an 
improved method, apparatus, and computer instructions for 
providing hardware assistance for performance tools for 
analyzing the performance of data processing systems. 
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SUMMARY OF THE INVENTION 



The present invention provides a method, apparatus, 
and computer instructions in a data processing system for 
rnonitoring the execution of instructions and accesses to 
memory locations. If an instruction is associated with a 
indicator, a counter associated with the instruction xs 
incremented in response to detecting execution of the 
instruction. The indicator may be associated with a 
memory location with a counter associated with the memory 
location being incremented in response to an access of 
the memory location. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The novel features believed characteristic of the 
invention are set forth in the appended claims. The 
invention itself, however, as well as a preferred mode of 
use, further objectives and advantages thereof, will best 
be understood by reference to the following detailed 
description of an illustrative embodiment when read xn 
conjunction with the accompanying drawings, wherein: 
Figure 1 is a block diagram of a data processing 
system in which the present invention may be implemented; 

Figure 2 is a block diagram of a processor system 
for processing information according to a preferred 
embodiment of the present invention; 

Figure 3 is a diagram illustrating components used 
in processing instructions associated with indicators in 
accordance with a preferred embodiment of the present 
invention; 

Figure 4 is a diagram illustrating one mechanism for 
associating a performance indicator with an instruction 
or memory location in accordance with a preferred 
embodiment ; 

Figure 5 is a diagram illustrating a bundle in 
accordance with a preferred embodiment of the present 
invention; 

Figure 6 is a diagram of a subroutine containing 
performance indicators in accordance with a preferred 
embodiment of the present invention; 
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Figur 7 is a flowchart of a process for processing 
instructions containing performance indicators in 
accordance with a preferred embodiment of the present 
invention; 

Figure 8 is a flowchart of a process for selectively 
sending instructions to an interrupt unit in accordance 
with a preferred embodiment of the present invention; 

Figure 9 is a flowchart of a process for generating 
an interrupt in response to an access of a memory 
location associated with a performance indicator in 
accordance with a preferred embodiment of the present 
invention; 

Figure 10 is a flowchart of a process for counting 
events in accordance with a preferred embodiment of the 

present invention; 

Figure 11 is a flowchart of a process for selective 
counting of instructions in accordance with a preferred 
embodiment of the present invention; 

Figure 12 is a flowchart of a process for selective 
counting of instructions in accordance with a preferred 
embodiment of the present invention; 

Figure 13 is a flowchart of a process for 
identifying instructions exceeding a threshold in 
accordance with a preferred embodiment of the present 
invention; 

Figure 14 is a flowchart of a process for accesses 
to a memory location in accordance with a preferred 
embodiment of the present invention; 
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Figure 15 is a block diagram illustrating components 
used for generating meta data, such as performance 
indicators, in accordance with a preferred embodiment of 

the present invention; 

Figure 16 is a diagram illustrating meta data in 
accordance with a preferred embodiment of the present 
invention; 

Figure 17 is a diagram illustrating components 
involved in loading and maintaining a performance 
instrumentation shadow cache in accordance with a 
preferred embodiment of the present invention; 

Figure 18 is a flowchart of a process for generating 
meta data for instructions in accordance with a preferred 
embodiment of the present invention; 

Figure 19 is a flowchart of a process for generating 
meta data for memory locations in accordance with a 
preferred embodiment of the present invention; 

Figure 20 is a flowchart of a process for counting 
execution for particular instructions in accordance with 
a preferred embodiment of the present invention; 

Figure 21 is a flowchart of a process for counting 
accesses to a particular memory location in accordance 
with a preferred embodiment of the present invention; 

Figure 22 is a diagram illustrating components used 
in accessing information collected with respect to the 
execution of instructions or the access of memory 
locations in accordance with a preferred embodiment of 
the present invention; 
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Figure 23 is a block diagram of components used in 
autonomically modifying code in a program to allow 
selective counting or profiling of sections of code in 
accordance with a preferred embodiment of the present 
invention; 

Figure 24 is a flowchart of a process for 
dynamically adding or associating performance indicators 
to an instruction in accordance with a preferred 
embodiment of the present invention; 

Figure 25 is a diagram illustrating components used 
to scan pages through associating performance indicators 
with instructions in a page in accordance with a 
preferred embodiment of the present invention; 

Figure 26 is a flowchart of a process for 
associating indicators to instructions in a page in 
accordance with a preferred embodiment of the present 
invention; 

Figure 27 is a diagram depicting call stack 
containing stack frames in accordance with a preferred 
embodiment of the present invention; 

Figure 28 is a flowchart of a process for 
identifying events associated with call and return 
instructions in which data is collected from a 
performance monitor unit in accordance with a preferred 
embodiment of the present invention; 

Figure 29 is a flowchart of a process for 
identifying instructions that have been executed more 
than a selected number of times in accordance with a 
preferred embodiment of the present invention; 
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Figure 30 is a flowchart of a process for examining 
a call stack and identifying a caller of a routine when a 
particular instruction is executed more than some 
selected number of times in accordance with a preferred 
embodiment of the present invention; 

Figure 31 is a diagram illustrating ranges of 
instructions and data that has been selected for 
monitoring in accordance with a preferred embodiment of 
the present invention; and 

Figure 32 is a flowchart of a process for counting 
the number of visits to a set range as well as the number 
of instructions executed within a set range in accordance 
with a preferred embodiment of the present invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

With reference now to Figure 1, a block diagram of a 
data processing system is shown in which the present 
invention may be implemented. Client 100 is an example of 
a computer, in which code or instructions implementing the 
processes of the present invention may be located. Client 
100 employs a peripheral component interconnect (PCI) 
local bus architecture. Although the depicted example 
employs a PCI bus, other bus architectures such as 
Accelerated Graphics Port (AGP) and Industry Standard 
Architecture (ISA) may be used. Processor 102 and main 
memory 104 are connected to PCI local bus 106 through PCI 
bridge 108. PCI bridge 108 also may include an integrated 
memory controller and cache memory for processor 102. 
Additional connections to PCI local bus 106 may be made 
through direct component interconnection or through add- in 
boards. in the depicted example, local area network (LAN) 
adapter 110, small computer system interface SCSI host bus 
adapter 112, and expansion bus interface 114 are connected 
to PCI local bus 106 by direct component connection. In 
contrast, audio adapter 116, graphics adapter 118, and 
audio/video adapter 119 are connected to PCI local bus 106 
by add- in boards inserted into expansion slots. Expansion 
bus interface 114 provides a connection for a keyboard and 
mouse adapter 120, modem 122, and additional memory 124. 
SCSI host bus adapter 112 provides a connection for hard 
disk drive 126, tape drive 128, and CD-ROM drive 130. 
Typical PCI local bus implementations will support three 
or four PCI expansion slots or add- in connectors. 
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An operating system runs on processor 102 and is used 
to coordinate and provide control of various components 
within data processing system 100 in Figure 1. The 
operating system may be a commercially available operating 
system such as Windows XP, which is available from 
Microsoft Corporation. An object oriented programming 
system such as Java may run in conjunction with the 
operating system and provides calls to the operating 
system from Java programs or applications executing on 
client 100. "Java" is a trademark of Sun Microsystems, 
Inc. Instructions for the operating system, the object- 
oriented programming system, and applications or programs 
are located on storage devices, such as hard disk drive 
126, and may be loaded into main memory 104 for execution 
by processor 102. 

Those of ordinary skill in the art will appreciate 
that the hardware in Figure 1 may vary depending on the 
implementation. Other internal hardware or peripheral 
devices, such as flash read-only memory (ROM), equivalent 
nonvolatile memory, or optical disk drives and the like, 
may be used in addition to or in place of the hardware 
depicted in Figure 1. Also, the processes of the present 
invention may be applied to a multiprocessor data 
processing system. 

For example, client 100, if optionally configured as 
a network computer, may not include SCSI host bus adapter 
112, hard disk drive 126, tape drive 128, and CD-ROM 130. 
In that case, the computer, to be properly called a 
client computer, includes some type of network 
communication interface, such as LAN adapter 110, modem 
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122, or the like. As another example, client 100 may be 
a stand-alone system configured to be bootable without 
relying on some type of network communication interface, 
whether or not client 100 comprises some type of network 
communication interface. As a further example, client 
100 may be a personal digital assistant (PDA), which is 
configured with ROM and/or flash ROM to provide non- 
volatile memory for storing operating system files and/or 
user-generated data. The depicted example in Figure 1 
and above-described examples are not meant to imply 
architectural limitations. 

The processes of the present invention are performed 
by processor 102 using computer implemented instructions, 
which may be located in a memory such as, for example, 
main memory 104, memory 124, or in one or more peripheral 

devices 126-130. 

Turning next to Figure 2, a block diagram of a 
processor system for processing information is depicted 
in accordance with a preferred embodiment of the present 
invention. Processor 210 may be implemented as processor 

102 in Figure 1. 

in a preferred embodiment, processor 210 is a single 
integrated circuit superscalar microprocessor. 
Accordingly, as discussed further herein below, processor 
210 includes various units, registers, buffers, memories, 
and other sections, all of which are formed by integrated 
circuitry. Also, in the preferred embodiment, processor 
210 operates according to reduced instruction set 
computer ("RISC") techniques. As shown in Figure 2, 
system bus 211 is connected to a bus interface unit 
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("BIU") 212 of processor 210. BIU 212 controls the 
transfer of information between processor 210 and system 

bus 211. 

BIU 212 is connected to an instruction cache 214 and 
to data cache 216 of processor 210. Instruction cache 214 
outputs instructions to sequencer unit 218. In response 
to such instructions from instruction cache 214, 
sequencer unit 218 selectively outputs instructions to 
other execution circuitry of processor 210. 

in addition to sequencer unit 218, in the preferred 
embodiment, the execution circuitry of processor 210 
includes multiple execution units, namely a branch unit 
220, a fixed-point unit A ("FXUA") 222, a fixed-point 
unit B ("FXUB") 224, a complex fixed-point unit ("CFXU") 
226, a load/store unit ("LSU") 228, and a floating-point 
unit ("FPU") 230. FXUA 222, FXUB 224, CFXU 226, and LSU 
228 input their source operand information from general- 
purpose architectural registers ("GPRs") 232 and fixed- 
point rename buffers 234. Moreover, FXUA 222 and FXUB 224 
input a "carry bit" from a carry bit ("CA") register 239. 
FXUA 222, FXUB 224, CFXU 226, and LSU 228 output results 
(destination operand information) of their operations for 
storage at selected entries in fixed-point rename buffers 
234. Also, CFXU 226 inputs and outputs source operand 
information and destination operand information to and 
from special-purpose register processing unit ("SPR 
unit") 237. 

FPU 230 inputs its source operand information from 
floating-point architectural registers ("FPRs") 236 and 
floating-point rename buffers 238. FPU 230 outputs 
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results (destination operand information) of its 
operation for storage at selected entries in floating- 
point rename buffers 238. 

in response to a Load instruction, LSU 228 inputs 
information from data cache 216 and copies such 
information to selected ones of rename buffers 234 and 
238. If such information is not stored in data cache 216, 
then data cache 216 inputs (through BIU 212 and system 
bus 211) such information from a system memory 239 
connected to system bus 211. Moreover, data cache 216 is 
able to output (through BIU 212 and system bus 211) 
information from data cache 216 to system memory 239 
connected to system bus 211. In response to a Store 
instruction, LSU 228 inputs information from a selected 
one of GPRS 232 and FPRs 236 and copies such information 

to data cache 216. 

Sequencer unit 218 inputs and outputs information to 
and from GPRs 232 and FPRs 236. From sequencer unit 218, 
branch unit 220 inputs instructions and signals 
indicating a present state of processor 210. In response 
to such instructions and signals, branch unit 220 outputs 
(to sequencer unit 218) signals indicating suitable 
memory addresses storing a sequence of instructions for 
execution by processor 210. In response to such signals 
from branch unit 220, sequencer unit 218 inputs the 
indicated sequence of instructions from instruction cache 
214. If one or more of the sequence of instructions is 
not stored in instruction cache 214, then instruction 
cache 214 inputs (through BIU 212 and system bus 211) 
such instructions from system memory 239 connected to 
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system bus 211. 

in response to the instructions input from 
instruction cache 214, sequencer unit 218 selectively 
dispatches the instructions to selected ones of execution 
units 220, 222, 224, 226, 228, and 230. Each execution 
unit executes one or more instructions of a particular 
class of instructions. For example, FXUA 222 and FXUB 224 
execute a first class of fixed-point mathematical 
operations on source operands, such as addition, 
subtraction, ANDing, ORing and XORing. CFXU 226 executes 
a second class of fixed-point operations on source 
operands, such as fixed-point multiplication and 
division. FPU 230 executes floating-point operations on 
source operands, such as floating-point multiplication 
and division. 

As information is stored at a selected one of rename 
buffers 234, such information is associated with a 
storage location (e.g. one of GPRs 232 or carry bit(CA) 
register 242) as specified by the instruction for which 
the selected rename buffer is allocated. Information 
stored at a selected one of rename buffers 234 is copied 
to its associated one of GPRs 232 (or CA register 242) in 
response to signals from sequencer unit 218. Sequencer 
unit 218 directs such copying of information stored at a 
selected one of rename buffers 234 in response to 
"completing" the instruction that generated the 
information. Such copying is called "writeback." 

As information is stored at a selected one of rename 
buffers 238, such information is associated with one of 
FPRs 236. information stored at a selected one of rename 
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buffers 238 is copied to its associated one of FPRs 236 
in response to signals from sequencer unit 218. Sequencer 
unit 218 directs such copying of information stored at a 
selected one of rename buffers 238 in response to 
••completing" the instruction that generated the 

information. 

Processor 210 achieves high performance by 
processing multiple instructions simultaneously at 
various ones of execution units 220, 222, 224, 226, 228, 
and 230. Accordingly, each instruction is processed as a 
sequence of stages, each being executable in parallel 
with stages of other instructions. Such a technique is 
called "pipelining." In a significant aspect of the 
illustrative embodiment, an instruction is normally 
processed as six stages, namely fetch, decode, dispatch, 
execute, completion, and writeback. 

in the fetch stage, sequencer unit 218 selectively 
inputs (from instruction cache 214) one or more 
instructions from one or more memory addresses storing 
the sequence of instructions discussed further 
hereinabove in connection with branch unit 220, and 

sequencer unit 218. 

in the decode stage, sequencer unit 218 decodes up 

to four fetched instructions. 

In the dispatch stage, sequencer unit 218 
selectively dispatches up to four decoded instructions to 
selected (in response to the decoding in the decode 
stage) ones of execution units 220, 222, 224, 226, 228, 
and 230 after reserving rename buffer entries for the 
dispatched instructions' results (destination operand 
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information) . In the dispatch stage, operand information 
is supplied to the selected execution units for 
dispatched instructions. Processor 210 dispatches 
instructions in order of their programmed sequence. 

in the execute stage, execution units execute their 
dispatched instructions and output results (destination 
operand information) of their operations for storage at 
selected entries in rename buffers 234 and rename buffers 
238 as discussed further hereinabove. In this manner, 
processor 210 is able to execute instructions out-of- 
order relative to their programmed sequence. 

In the completion stage, sequencer unit 218 
indicates an instruction is "complete." Processor 210 
"completes" instructions in order of their programmed 
sequence . 

in the writeback stage, sequencer 218 directs the 
copying of information from rename buffers 234 and 238 to 
GPRS 232 and FPRs 236, respectively. Sequencer unit 218 
directs such copying of information stored at a selected 
rename buffer. Likewise, in the writeback stage of a 
particular instruction, processor 210 updates its 
architectural states in response to the particular 
instruction. Processor 210 processes the respective 
-writeback" stages of instructions in order of their 
programmed sequence. Processor 210 advantageously merges 
an instruction's completion stage and writeback stage in 

specified situations. 

In the illustrative embodiment, each instruction 
requires one machine cycle to complete each of the stages 
of instruction processing. Nevertheless, some 
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instructions (e.g., complex fixed-point instructions 
executed by CFXU 226) may require more than one cycle. 
Accordingly, a variable delay may occur between a 
particular instruction's execution and completion stages 
in response to the variation in time required for 
completion of preceding instructions. 

Completion buffer 248 is provided within sequencer 
218 to track the completion of the multiple instructions 
which are being executed within the execution units. Upon 
an indication that an instruction or a group of 
instructions have been completed successfully, in an 
application specified sequential order, completion buffer 
248 may be utilized to initiate the transfer of the 
results of those completed instructions to the associated 
general -purpose registers. 

in addition, processor 210 also includes performance 
monitor unit 240, which is connected to instruction cache 
214 as well as other units in processor 210. Operation of 
processor 210 can be monitored utilizing performance 
monitor unit 240, which in this illustrative embodiment 
is a software-accessible mechanism capable of providing 
detailed information descriptive of the utilization of 
instruction execution resources and storage control. 
Although not illustrated in Figure 2, performance monitor 
unit 240 is coupled to each functional unit of processor 
210 to permit the monitoring of all aspects of the 
operation of processor 210, including, for example, 
reconstructing the relationship between events, 
identifying false triggering, identifying performance 
bottlenecks, monitoring pipeline stalls, monitoring idle 
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processor cycles, determining dispatch efficiency, 
determining branch efficiency, determining the 
performance penalty of misaligned data accesses, 
identifying the frequency of execution of serialization 
instructions, identifying inhibited interrupts, and 
determining performance efficiency. The events of 
interest also may include, for example, time for 
instruction decode, execution of instructions, branch 
events, cache misses, and cache hits. 

Performance monitor unit 240 includes an 
implementation-dependent number (e.g., 2-8) of counters 
241-242, labeled PMC1 and PMC 2 , which are utilized to 
count occurrences of selected events . Performance monitor 
unit 240 further includes at least one monitor mode 
control register (MMCR) . In this example, two control 
registers, MMCRs 243 and 244 are present that specify the 
function of counters 241-242. Counters 241-242 and MMCRs 
243-244 are preferably implemented as SPRs that are 
accessible for read or write via MFSPR (move from SPR) 
and MTSPR (move to SPR) instructions executable by CFXU 
226. However, in one alternative embodiment, counters 
241-242 and MMCRs 243-244 may be implemented simply as 
addresses in I/O space. In another alternative 
embodiment, the control registers and counters may be 
accessed indirectly via an index register. This 
embodiment is implemented in the IA-64 architecture in 
processors from Intel Corporation. 

Additionally, processor 210 also includes interrupt 
unit 250, which is connected to instruction cache 214. 
Additionally, although not shown in Figure 2, interrupt 
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unit 250 is connected to other functional units within 
processor 210. Interrupt unit 250 may receive signals 
from other functional units and initiate an action, such 
as starting an error handling or trap process. In these 
examples, interrupt unit 250 is employed to generate 
interrupts and exceptions that may occur during execution 
of a program. 

The present invention provides an ability to monitor 
the execution of specific instructions as well as the 
access of specific memory locations during the execution 
of a program. Specifically, a spare field may be used to 
hold an indicator that identifies the instruction or 
memory location as one that is to be monitored by a 
performance monitor unit or by some other unit in a 
processor. ■ Alternatively, the indicator may be stored in 
another location in association with the instruction or 
memory location. In the case in which the indicator is 
placed in the instruction, a spare field is typically 
used, but in some cases the instruction may be extended 
to include the space needed for the indicator. With this 
case, the architecture of the processor may require 
changes. For example, a 64 bit architecture may be 
changed to a 65 bit architecture to accommodate the 
indicator. With respect to accesses of data, an 
indicator may be associated with the data or memory 
locations in which the data is located. 

Turning now to Figure 3, a diagram illustrating 
components used in processing instructions associated 
with indicators is depicted in accordance with a 
preferred embodiment of the present invention. 
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instruction cache 300 receives bundles 302. Instruction 
cache 300 is an example of instruction cache 214 in 
Figure 2. A bundle is a grouping of instructions. This 
type of grouping of instructions is typically found in an 
IA-64 processor, which is available from Intel 
Corporation. Instruction cache 300 processes 
instructions for execution. 

As part of this processing of instructions, 
instruction cache 300 determines which instructions are 
associated with indicators. These indicators also are 
referred to as "performance indicators" in these 
examples. Signals 304 have been associated with 
performance indicators. As a result, signals 304 for the 
instructions are sent to performance monitor unit 306. 
Performance monitor unit 306 is an example of performance 
monitor unit 240 in Figure 2. 

■ When instruction cache 300 determines that an 
instruction associated with an indicator is present, a 
signal is sent to indicate that a marked instruction is 
being executed. In these examples, a marked instruction 
is an instruction associated with a performance 
indicator. Alternatively, a performance indicator may 
indicate that all items or instructions in a bundle are 
marked to be counted. Additionally, signals for these 
instructions are sent by instruction cache 300 to the 
appropriate functional unit. Depending on the particular 
implementation, a functional unit other than performance 
monitor unit 306 may count execution of instructions. In 
the case that the performance indicators are in the 
instructions, or in the bundles, the cache unit, 
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instruction cache 300, detects the indicators and sends 
signals to performance monitor unit 306. 

When signals for these instructions are received by 
performance monitor unit 306, performance monitor unit 
306 counts events associated with execution of 
instructions 304. As illustrated, performance monitor 
unit 306 is programmed only to count events for 
instructions associated with performance indicators. In 
other words, an indicator associated with a instruction 
or memory location is used to enable counting of events 
associated with the instruction or memory location by 
performance monitor unit 306. If an instruction is 
received by instruction cache 300 without a performance 
indicator, then events associated with that instruction 
are not counted. In summary, the performance indicators 
enable the counting on a per instruction or per memory 
location basis in a processor. 

Performance monitor unit 306 counts events for 
instructions associated with performance indicators, if 
performance monitor unit 306 is set in a mode to count 
metrics enabled for these types of marked instructions . 
in some cases, performance monitor unit 306 may be set to 
perform some other type of counting, such as counting 
execution of all instructions, which is a currently 
available function. 

With respect to the accessing of data in memory 
locations, the data and indicators are processed by a 
data cache, such as data cache 216 in Figure 2, rather 
than by an instruction cache. The data cache sends 
signals indicating that marked memory locations are being 
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accessed to performance monitor unit 306. Marked memory 
locations are similar to marked instructions. These 
types of memory locations are ones associated with a 
performance indicator. 

Turning next to Figure 4, a diagram illustrating one 
mechanism for associating a performance indicator with an 
instruction or memory location is depicted in accordance 
with a preferred embodiment of the present invention. 
Processor 400 receives instructions from cache 402. In 
this example, the indicators are not stored with the 
instructions or in the memory locations in which data is 
found. instead, the indicators are stored in a separate 
area of storage, performance instrumentation shadow cache 
404. The storage may be any storage device, such as, for 
example, a system memory, a flash memory, a cache, or a 
disk. 

When processor 400 receives an instruction from 
cache 402, processor 400 checks performance 
instrumentation shadow cache 404 to see whether a 
performance indicator is associated with the instruction. 
A similar check is made with respect to accesses of 
memory locations containing data. In one embodiment, a 
full shadow word is provided for each corresponding word 
that does not affect the actual data segments. In other 
words, processor 400 allows for the architecture or 
configuration of cache 402 to remain unchanged. In these 
examples, the mapping described is word for word. 
However, some other type of mapping may be used, such as 
a shadow bit per data word in which a bit in performance 
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instrumentation shadow cache 404 corresponds to one word 
of data. 

With respect to this type of architecture, the 
compilers, using this feature, create the debug 
information in a separate work area from the data area 
themselves in a manner similar to debug symbols. When a 
module is loaded, the extra information, performance 
indicators, is prepared by the loader so that it will be 
available to incorporate into performance instrumentation 
shadow cache 404 when instructions are loaded into cache 
402 . These cache areas may be intermingled and either 
marked as such or understood by the mode of operation. 
Processor 400 uses the performance indicators to 
determine how the related data accesses and instruction 
executions are to be counted or made to take exceptions, 
in these examples, the process is programmed by a 
debugger or a performance analysis program to know 
whether to use the shadow information while it is 
executing instructions. 

Turning next to Figure 5, a diagram illustrating a 
bundle is depicted in accordance with a preferred 
embodiment of the present invention. Bundle 500 contains 
instruction slot 502, instruction slot 504, instruction 
slot 506 and template 508. As illustrated, bundle 500 
contains 128 bits. Each instruction slot contains 41 
bits, and template 508 contains 5 bits. Template 508 is 
used to identify stops within the current bundle and to 
map instructions within the slots to different types of 
execution units. 
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Spare bits within bundle 500 are used to hold 
indicators of the present invention. For example, 
indicators 510, 512, and 514 are located within 
instruction slots 502, 504, and 506, respectively. These 
indicators may take various forms and may take various 
sizes depending on the particular implementation, 
indicators may use a single bit or may use multiple bits. 
A single bit may be used to indicate that events are to 
be counted in response to execution of that instruction. 
Multiple bits may be used to identify a threshold, such 
as a number of processor or clock cycles for instruction 
execution that may pass before events should be counted. 
Further, these bits may even be used as a counter for a 
particular instruction. A similar use of fields may be 
used for indicators that mark data or memory locations . 

Alternatively, template 508 may be used to contain a 
bundle of related indicators, so that one bit is used to 
identify all of the instructions in a bundle. Also, the 
bundle itself could be extended to be 256 bits or some 
other number of bits to contain the extra information for 
the performance indicators. 

Turning next to Figures 6A and 6B, diagrams of a 
subroutine containing performance indicators and data 
containing performance indicators are depicted in 
accordance with a preferred embodiment of the present 
invention. In this example, subroutine 600 in Figure 6A 
includes a number of instructions in which instructions 
602, 604, and 606 are associated with performance 
indicators. These instructions also are referred to as 
marked instructions. When these instructions are 



28 

Docket No. AUS920030481US1 



executed, events associated with those instructions are 
counted to obtain data for software tools to analyze the 
performance of a data processing system executing a 

subroutine 600. 

Data or memory locations containing data may be 
marked with indicators in a similar manner. These 
indicators are used in counting accesses to the data or 
memory locations in these examples. In Figure 6B, data 
610 includes data associated with performance indicators. 
Data 612 and data 614 are sections of data 610 that are 
associated with performance indicators. These sections 
of data, which are associated with performance 
indicators, also are referred to as marked data. 

Turning now to Figure 7, a flowchart of a process 
for processing instructions containing performance 
indicators is depicted in accordance with a preferred 
embodiment of the present invention. The process 
illustrated in Figure 7 may be implemented in an 
instruction cache, such as instruction cache 214 in 
Figure 2 . 

The process begins by receiving a bundle (step 700) . 
in these examples, each bundle has a format similar to 
bundle 500 in Figure 5. An instruction in the bundle is 
identified (step 702). A determination is made as to 
whether a performance indicator associated with the 

• /ofpn 704) This determination 

instruction is present (step /u«; . 

may be made by examining an appropriate field in the 
instruction or bundle. Alternatively, a performance 
instrumentation shadow cache, such as performance 
instrumentation shadow cache 404 in Figure 4 may be 
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checked to see if a performance indicator is associated 
with the instruction. 

If a performance indicator is present, a signal is 
sent to a performance monitor unit (step 706) . Upon 
receiving this signal, the performance monitor unit will 
count events associated with the execution of the 
instruction. Additionally, the instruction is processed 
(step 708). Processing of the instruction includes, for 
example, sending the instruction to the appropriate 
functional unit for execution. 

Thereafter, a determination is made as to whether 
additional unprocessed instructions are present in the 
bundle (step 710) . If additional unprocessed 
instructions are present in the bundle, the process 
returns to step 702 as described above. Otherwise, the 
process terminates. Turning back to step 704, if the 
performance indicator is not present, the process 
proceeds directly to step 708. 

Turning now to Figure 8 a flowchart of a process for 
selectively sending signals to an interrupt unit is 
depicted in accordance with a preferred embodiment of the 
present invention. The process illustrated in Figure 8 
may be implemented in an instruction cache, such as 
instruction cache 242 in Figure 2 . This process is 
employed in cases in which monitoring events using a 
performance monitor unit may miss certain events. For 
example, a performance monitor unit counts events. When 
a cache miss occurs, a signal is sent to the performance 
monitor unit. When the meta data for a corresponding 
cache line is loaded into the cache, the appropriate 
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signal or signals also are raised. If the meta data 
indicates that an exception is to be raised, then a 
signal is sent to the interrupt unit in which the signal 
indicates that an exception is to be raised. 

The process begins by receiving a bundle (step 800). 
An instruction in the bundle is identified (step 802) . A 
determination is made as to whether a performance 
indicator associated with the instruction is present 
(step 804) . The signal sent to the interrupt unit to 
indicate an exception is to be raised is different from 
the signal sent to the performance monitor unit. For 
example, an instruction may be associated with a specific 
performance indicator having a first value that causes a 
signal to be sent to the interrupt unit. A second value 
for a performance indicator may be used to send a 
different signal to the performance monitor unit. If a 
performance indicator having the first value is present, 
the signal is sent to an interrupt unit (step 806). Upon 
receiving this signal, the interrupt unit initiates 
appropriate call flow support to process this interrupt. 
The call flow support may, for example, record cache 
misses that may be missed by a functional unit trying to 
access instructions or data in a cache. 

Additionally, the instruction is processed (step 
808). Processing of the instruction includes, for 
example, sending the instruction to the appropriate 
functional unit for execution. 

Thereafter, a determination is made as to whether 
additional unprocessed instructions are present in the 
bundle (step 810) . If additional unprocessed 
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instructions are present in the bundle, the process 
returns to step 802 as described above. Otherwise, the 
process terminates. Turning back to step 804, if the 
performance indicator is not present, the process 
proceeds directly to step 808. 

With reference now to Figure 9, a flowchart of a 
process for generating an interrupt in response to an 
access of a memory location associated with a performance 
indicator is depicted in accordance with a preferred 
embodiment of the present invention. The process 
illustrated in Figure 9 may be implemented in a data 
cache, such as data cache 246 in Figure 2. 

The process begins by identifying a request to 
access a memory location (step 900) . In response to 
identifying this request, a determination is made as to 
whether a performance indicator is associated with the 
memory location (step 902) . If a performance indicator 
is associated with the memory location, an interrupt is 
generated by sending a signal to the interrupt unit (step 
904) . Thereafter, the access to the memory location is 
processed (step 906) with the process terminating 
thereafter. 

in Figure 10, a flowchart of a process for counting 
events is depicted in accordance with a preferred 
embodiment of the present invention. The process 
illustrated in Figure 10 may be implemented in a 
performance monitor unit, such as performance monitor 
unit 240 in Figure 2. 

The process begins by receiving a signal from an 
instruction cache indicating that an instruction with a 
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performance indicator is being processed (step 1000) . 
Next, events associated with the instruction being 
processed are counted (step 1002) with the process 
terminating thereafter. The counting of events may be 
stored in a counter, such as counter 241 in Figure 2. 

With reference next to Figure 11, a flowchart of a 
process for selective counting of instructions is 
depicted in accordance with a preferred embodiment of the 
present invention. The process illustrated in Figure 11 
may be implemented in an instruction cache, such as 
instruction cache 214 in Figure 2. 

The process begins by determining whether an 
instruction associated with a performance indicator has 
been received (step 1100). In this example, the 
indicator causes counting of events for this instruction 
and all subsequent instructions executed by the 
processor. Alternatively, the indicator could be an 
instruction itself which indicates the new mode of 
counting is to be started. If an instruction with an 
indicator has been received, a flag is set to start 
counting events for instructions (step 1102). This flag 
indicates that counting events for instructions should 
start . 

Next, a determination is made as to whether an 
instruction with an indicator has been received (step 
1104). Alternatively, the indicator could be an 
instruction itself which indicates the new mode of 
counting is to be stopped. If an instruction with an 
indicator is received, the flag is unset to stop countxng 
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the events (step 1106) with the process terminating 
thereafter. 

The indicator in step 1100 and step 1104 may be the 
same indicator in which the indicator toggles the setting 
and unsetting of the flag. In another implementation, 
two different indicators may be used in which a first 
indicator only sets the flag. A second indicator is used 
to unset the flag. Communication between a cache unit, 
such as an instruction cache or a data cache, and the 
performance monitor unit to indicate a mode of counting 
may be implemented simply with a high signal when 
counting is to occur and a low signal when counting is no 

longer enabled. 

" With reference next to Figure 12, a flowchart of a 
process for selective counting of instructions is 
depicted in accordance with a preferred embodiment of the 
present invention. The process illustrated in Figure 12 
may be implemented in an instruction cache, such as 
instruction cache 214 in Figure 2. 

The process begins by checking a flag (step 1200) . 
A determination is made as to whether the flag is set 
(step 1202). If the flag is set, a signal is sent to the 
performance monitor unit to enable this unit to count 
events (step 1204) with the process terminating 
thereafter. Otherwise, a signal is sent to the 
performance monitor unit to disable the counting of 
events (step 1206) with the process terminating 
thereafter. 

The processes illustrated in Figures 11 and 12 count 
events for all instructions after an instruction is 
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associated with a performance indicator. In this manner, 
fewer bits may be used to toggle counting of events. 
Further, with the counting of all instructions, events 
associated with calls to external subroutines may be 
counted. 

Turning now to Figure 13, a flowchart of a process 
for identifying instructions exceeding a threshold is 
depicted in accordance with a preferred embodiment of the 
present invention. The process illustrated in Figure 13 
may be implemented in an instruction cache, such as 
instruction cache 214 in Figure 2. 

The process begins by receiving an instruction 
associated with a performance indicator (step 1300) . A 
threshold is identified for the instruction (step 1302) . 
in these examples, the threshold relates to a number of 
processor or clock cycles needed to complete an 
instruction. If the cache latency or amount of time 
needed to access the cache exceeds the threshold value, 
that event is counted. The threshold value is set within 
the indicator in these examples. 

For example, three bits may be used to set eight 
different values for the threshold. For example, »xxl» = 
10 cycles, «xlx'< = 50 cycles, and «lxx'< = 100 cycles. 
Some combination of these three bits may be used to set 
values for the threshold. More or fewer bits may be used 
and different values may be assigned to the bits 
depending on the specific implementation. The meaning of 
the bits may also be controlled through an interface, 
such as a set of registers that may be used to set the 
meaning of each of the bits. These registers are ones 
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that are added to the processor architecture for this 

specific purpose. 

Cycles for executing the instruction are monitored 
(step 1304) . A determination is made as to whether the 
threshold has been exceeded for this instruction (step 
1306) . If the threshold has been exceeded, then a 
selected action is performed (step 1308) . This selected 
action may take different forms depending on the 
particular implementation. For example, a counter may be 
incremented each time the threshold is exceeded. 
Alternatively, an interrupt may be generated. The 
interrupt may pass control to another process to gather 
data For example, this data may include a call stack 
and information about the call stack. A stack is a region 
of reserved memory in which a program or programs store 
status data, such as procedure and function call 
addresses, passed parameters, performance monitor counter 
values, and sometimes local variables. 

A determination is made as to whether monitoring is 
to end (step 1310) . Step 1310 may be implemented one 
instruction at a time. When an instruction is executed 
or the threshold is exceeded, a signal is sent. In this 
example, execution of a single instruction results in one 
signal being sent. In the case in which multiple 
instructions may be executed at the same time, multiple 
signals may be needed to indicate the execution of each 
instruction. In some embodiments, a sampling approach 
may be supported, where the threshold is only supported 
for one instruction at a time. This may be done by only 
supporting thresholds for those instructions that are in 
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a particular position in the processor's instruction 
queue. In other embodiments, one signal may be sent if 
at least one of the marked instructions exceeds the 
threshold. For each instruction in which a threshold is 
exceeded, a separate signal is raised or generated for 
that instruction. 

If the monitoring is to end, the collected 
information is sent to a monitoring program (step 1312), 
with the process terminating thereafter. Otherwise, the 
process returns to step 1304 as described above. In step 
1306, if the threshold is not exceeded for the 
instruction, the process proceeds directly to step 1310. 

A similar process may be implemented in a data 
cache, such as data cache 216 in Figure 2 to monitor 
accesses to memory locations. The process illustrated in 
Figure 13 may be adapted to identify the cycles needed to 
access data in a memory location. As with the execution 
of instructions, counting occurs or an interrupt is 
generated when the amount of time needed to access the 
data in a memory location exceeds a specified threshold. 

As with the other examples, these indicators may be 
included as part of the instruction or with the data in a 
memory location. Alternatively, these indicators may be 
found in a performance instrumentation shadow cache or 
memory in association with the instruction or data. 

With reference to Figure 14, a flowchart of a 
process for monitoring accesses to a memory location is 
depicted in accordance with a preferred embodiment of the 
present invention. The process illustrated in Figure 14 
may be implemented in a data cache, such as data cache 
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216 in Figure 2. This process is used to count accesses 
to data in a memory location. 

The process begins by receiving data associated with 
a performance indicator (step 1400) . A determination is 
made as to whether a memory location for the data has 
been accessed (step 1402) . If the memory location has 
been accessed, then a counter is incremented (step 1404) . 
A determination is made as to whether monitoring is to 
end (step 1406) . If monitoring of the memory location is 
to end, the process terminates. Otherwise, the process 
returns to step 1402. In step 1402, if the memory 
location is not accessed, then the process proceeds to 
step 1406. 

Turning to Figure 15, a block diagram illustrating 
components used for generating meta data, such as 
performance indicators, is depicted in accordance with a 
preferred embodiment of the present invention. The 
compiler supports directives embedded in the source that 
indicate the meta data to be generated. Compiler 1500 
may generate instructions 1502 for execution and meta 
data for monitoring. As instruction or data cache pages 
are loaded into memory, the operating system program 
loader/linker and/or the performance monitoring program, 
reads the meta data generated by compiler 1500 and loads 
the meta data into memory, such as performance monitor 
section 1506, in these examples. The section itself is 
marked as meta data 1504. The processor may accept meta 
data 1504 in the format of the compiler generated section 
data in performance monitor section 1506 and populate 
processor's internal performance instrumentation shadow 
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cache with the data. A block oriented approach is 
described with reference to Figur 17 below. 

In one embodiment the format simply has a 
performance instrumentation shadow cache entry for each 
of its block or sector references and moves meta data 
1504 to its corresponding shadow entry or entries, 
instead of having a performance instrumentation shadow 
cache, the internal format of the cache itself may be 
modified to contain meta data 1504. In embodiments where 
the instruction stream itself is modified to contain the 
meta data, then either the loader updates the instruction 
stream to contain the appropriate indicators and work 
areas or compiler 1500 has generated the code to contain 
meta data 1504. In either case, after the code is 
loaded, the processor receives the meta data 1504. 

in addition, meta data 1504 may be placed into 
performance instrumentation shadow memory 1505 in 
association with instructions 1502. Compiler 1500 
produces information in a table or debug data section. 
The performance monitoring program loads this information 
into shadow data areas in performance instrumentation 
shadow memory 1505. Alternatively, the debug areas may 
be automatically populated by the operating system and 
the processor working together. 

instructions 1502 may then be executed by processor 
1508. Compiler 1500 may set a register such as mode 
register 1510 in processor 1508. When this register is 
set, processor 1508 looks at meta data 1504 in 
performance instrumentation shadow memory 1505 when 
executing instructions 1502 to determine whether 
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performance indicators in meta data 1504 are associated 
with instructions that are being executed in instructions 
1502 . These performance indicators are handled using 
processes, such as those described above with reference 
to Figures 2-14. If mode register 1510 is not set, then 
meta data 1504 is ignored when instructions 1502 are 

A similar process may be performed with respect to 
data in memory location 1512. Depending on the 
particular implementation, meta data 1504 may be placed 
within the instruction or within the data, rather than in 
performance instrumentation shadow memory 1505. However, 
by placing meta data 1504 in performance instrumentation 
shadow memory 1505, the generation of meta data 1504 may 
be performed dynamically when meta data 1504 is placed xn 
performance instrumentation shadow memory 1505. 

This feature allows for selection and monitoring of 
instructions to occur without having to modify the 
program. In other words, compiler 1500 may generate meta 
data 1504 after instructions 1502 have been compiled for 
execution by processor 1508. Setting mode register 1510 
causes processor 1508 to look for meta data 1504 in 
performance instrumentation shadow memory 1505 without 
having to modify instructions 1502. In these examples, 
meta data 1504 take the form of performance indicators 
that tell processor 1508 how to handle the execution of 
instructions 1502 and/or data accesses to memory location 
1512. 

Turning next to Figure 16, a diagram illustrating 
meta data is depicted in accordance with a preferred 
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embodiment of the present invention. Meta data 1600 is 
an example of meta data 1504 in Figure 15 . This meta 
data is generated by a compiler, such as compiler 1500. 

in this example, meta data 1600 includes 5 entries, 
entry 1602, 1604, 1606, 1608, and 1610 as indicated by 
line 1612 in meta data 1600. Each of these entries 
includes an offset, a length, and a flag for describing 
the instrumentation of code in this example. 

Entry 1602 has an offset of 0 with an entry length 
of 120 bytes. Flag 1614 indicates that all instructions 
within the range indicated by entry length 1616 need to 
be counted. In these examples, each instruction has a 
length of 4 bytes. Entry 1604 has an entry length of 4 
bytes, which corresponds to an instruction. Flag 1618 
indicates that an exception should be generated upon 
execution of this instruction. 

in entry 1606, an instruction beginning at an offset 
of 160 bytes is associated with flag 1620. This flag 
indicates that the instruction should be counted if the 
threshold, 100 cycles, is exceeded. 

Flag 1622 in entry 1608 indicates that tracing 
should start at the instruction having an offset of 256 
bytes. Tracing stops as indicated by flag 1624 in entry 
1610, which has a flag for the instruction at an offset 

of 512 bytes. 

These flags are used to generate the performance 
indicators that are associated with the instructions. 
The operating system moves this meta data generated by 
the compiler and processes the meta data into a 
performance instrumentation shadow memory, such as 
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performance instrumentation shadow memory 1506 in Figure 
15. Alternatively, this meta data may be placed into 
fields within the instructions depending on the 
particular implementation. 

With reference now to Figure 17, a diagram 
illustrating components involved in loading and 
maintaining a performance instrumentation shadow cache 
are depicted in accordance with a preferred embodiment of 
the present invention. In this example, existing cache 
1700 contains primary segment 1702. Primary segment 1702 
includes blocks 1704, 1706, 1708, 1710, 1712, 1714, 1716, 
1718, 1720, 1722, and 1724. Translation table 1726 is 
used' to provide a mapping for blocks 1704-1724 in primary 
segment 1702 to blocks in perfinst segment 1728. The 
data in this segment is placed into new performance 
instrumentation shadow cache 1730. 

At program compile time, the compiler generates a 
new performance instrumentation data section as 
previously described. At program load time, the loader 
queries the processor to determine ■ cache line size. The 
loader parses perfinst segment 1728 and constructs a 
shadow segment, in the format required by the processor, 
for any text or data segment that the loader loads. This 
shadow segment is placed into new performance 
instrumentation shadow cache 1730. 

Each block in the shadow segment contains meta data 
for instructions or data in the corresponding primary 
cache block. This meta data includes, for example, 
flags, tag fields, threshold, and count fields for each 
tagged item in a block in primary segment 1702. This 
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meta data also may include a flag that represents all the 
instructions or data in the block. 

The loader constructs a table mapping, translation 
table 1726, for each block in primary segment 1702 to a 
corresponding perfinst block, such as block 1732, 1734, 
1736, 1738, 1740, 1742, 1744, 1746, 1748, 1750, and 1752 
in perfinst segment 1728. Further, the loader registers 
the head of this table, translation table 1726, and the 
location and size of primary segment 1702 with the 
processor . 

At page replacement time, paging software provides a 
new interface to associate perfinst segment 1728 with the 
corresponding primary segment, primary segment 1702. 
When primary segment 1702 pages in or out, perfinst 
segment 1728 pages in or out as well. 

At cache line replacement time, the processor 
contains new performance instrumentation shadow cache 
1730 with cache frames directly associated with the 
frames in the existing data and instruction caches, such 
as existing cache 1700. When the processor's instructxon 
or data cache loads a new line, the cache also must load 
the corresponding perfinst block into the performance 
instrumentation shadow cache, new performance 
instrumentation shadow cache 1730. The processor sees 
(from the registration data given by the loader at 
program load time) that the processor is bringing a block 
into its cache that has an associated perfinst segment, 
perfinst segment 1728. The processor looks in 
translation table 1726 associated with this segment, 
finds a reference to the perfinst block corresponding to 
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the block it is about to load and loads the perfinst 
block into new performance instrumentation shadow cache 
1730. in these examples, cache misses associated with 
meta data are not signaled or are treated differently 
from cache misses associated data in a primary cache 
block, such as in primary segment 1702. 

With reference now to Figure 18, a flowchart of a 
process for generating meta data for instructions is 
depicted in accordance with a preferred embodiment of the 
present invention. The process illustrated in Figure 18 
may be implemented by a performance monitoring program. 

The process begins by identifying an instruction for 
profiling (step 1800). This instruction may be, for 
example, one that has been executed more than a selected 
number of times. Meta data is generated for the 
identified instruction (step 1802) . This meta data takes 
the form of a performance indicator. The performance 
indicator may, for example, increment a counter each time 
the instruction is executed, increment a counter if the 
number of cycles needed to execute the instruction 
exceeds a threshold value, toggle counting of events for 
all instructions for all events after this instruction, 
or count events occurring in response to executing the 
instruction. In a preferred embodiment, the counters are 
in the associated performance instrumentation shadow 
cache and take some number of bits to allow for a one to 
one correspondence between the data or instructions in 
the cache and the bits reserved for counting. 

The meta data is then associated with the 
instruction (step 1804). Next, a determination is made 
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as to whether more instructions are present for 
processing (step 1806). If additional instructions are 
present, the process returns to step 1800. Otherwise, 
the process terminates. A similar process may be used to 
dynamically generate meta data for data in memory 
locations . 

With reference now to Figure 19, a flowchart of a 
process for generating meta data for memory locations is 
depicted in accordance with a preferred embodiment of the 
present invention. The process illustrated in Figure 19 
may be implemented in a compiler such as compiler 1500 in 
Figure 15. 

The process begins by identifying a memory location 
for profiling (step 1900) . Step 1900 occurs by detecting 
access to a marked location. Meta data is generated for 
the identified memory location (step 1902). This meta 
data takes the form of a performance indicator. The 
performance indicator may, for example, increment a 
counter each time the memory location is accessed, 
increment a counter if the number of cycles needed to 
access the memory location exceeds a threshold value, or 
toggle counting of all accesses to memory locations. The 
meta data is then associated with the memory location 
(step 1904). Next, a determination is made as to 
whether more memory locations are present for processing 
(step 1906) . If additional memory locations are present, 
the process returns to step 1900. Otherwise, the process 
terminates . 

Turning now to Figure 20, a flowchart of a process 
for counting execution for particular instructions is 
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depicted in accordance with a preferred embodiment of the 
present invention. The process illustrated in Figure 20 
may be implemented in an instruction cache such as 
instruction cache 214 in Figure 2. 

The process begins by executing an instruction (step 
2000) . A determination is made as to whether a counter 
is associated with the instruction (step 2002) . The 
counter may be included in a field within the instruction 
or may be in a performance instrumentation shadow memory. 
If a counter is associated with the instruction, the 
counter is incremented (step 2004) with the process 
terminating thereafter. Otherwise, the process 
terminates without incrementing the counter. The counter 
may be reset if the counter exceeds a threshold value. 

When the counter is implemented as part of the 
instructions, the counter may be of limited size. In 
this case, a threshold value for the counter may be set 
to indicate when the counter is in danger of overflowing. 
The counter may then be reset after the value has been 
read. This value may be read by a performance monitor 
unit or by a program used to analyze data. APIs may be 
implemented to access this data. 

Turning now to Figure 21, a flowchart of a process 
for counting accesses to a particular memory location is 
depicted in accordance with a preferred embodiment of the 
present invention. The process illustrated in Figure 21 
may be implemented in a data cache, such as data cache 
216 and instruction cache 214 in Figure 2. 

The process begins by detecting access to a memory 
location (step 2100) . A determination is made as to 
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whether a counter is associated with the memory location 
(step 2102) . The counter may be included within the 
memory location or may be in a performance 
instrumentation shadow memory. If a counter is 
associated with the memory location, the counter is 
incremented (step 2104) with the process terminating 
thereafter. Otherwise, the process terminates without 
incrementing the counter. 

With reference next to Figure 22, a diagram 
illustrating components used in accessing information 
collected with respect to the execution of instructions 
or the access of memory locations in accordance with a 
preferred embodiment of the present invention. In this 
example, instruction unit 2200 executes instruction 2202 
and increments counter 2204. This counter is incremented 
each time instruction 2202 is executed. In this example, 
instruction unit 2200 may be implemented as instruction 
cache 214 in Figure 2. 

When the instruction or data cache pages are loaded 
into memory, the operating system program loader/linker 
and/or the performance monitoring program, reads the meta 
data generated by the compiler and determines that 
counting is associated with instruction or data access, 
then the loading process allocates data areas to maintain 
the counters as part of its perfinst segment. The size 
of the counters and the granularity of the data access 
determine the amount of work area to be allocated. 

in a simple case, the granularity of the data or 
instruction access could be word size (so that an access 
to any byte in the word is considered an access) and the 
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counts could also be a word size. In this case, one to 
many mapping is present between the primary segment and 
the perfinst segment (a full word to contain the counts 
or threshold is not required) . The loading process 
allocates a shadow page or pages and tells the processor 
to use the shadow page(s) to contain the counts. Details 
of this mapping are described above with reference to 
Figure 17. The cache unit in the processor maintains a 
shadow block entry to indicate the corresponding page to 
contain the count information. Different mapping and 
different levels of support could be provided. 

in an alternative embodiment, the compiler allocates 
the work areas to maintain the counts and indicates the 
placement of these work areas in its generated data 
areas. An entry in the meta data could indicate the 
start of the data, the number of bytes of data, 
granularity of the data, the start of the count area, and 
the granularity of each counting unit. In either case, 
the meta data is loaded into the processor and the 
processor populates its internal (shadow) cache with the 
meta data. In illustrative embodiments in which the 
instruction stream itself is modified to contain the meta 
data, then either the loader updates the instruction 
stream to contain the appropriate indicators and work 
areas or the compiler has generated the code to contain 
the meta data. In either case, after the code is loaded, 
the processor receives the meta data. 

Data unit 2206 may be implemented as data cache 206 
in Figure 2. In this example, each time data 2208 is 
accessed, counter 2210 is incremented. Data 2208 and 
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counter 2210 are both located in a particular memory 
location, in these examples, a new instruction may be 
employed in which the instruction is called 
ReadDataAccessCount ( RDAC ) that takes a data address and 
a register and puts the count associated with that data 
address in the register. 

Each of these events, instruction execution and data 
access, results in incrementing of a counter. The 
mechanism of the present invention provides an interface, 
hardware interface 2212, to access this collected data, 
in these examples, hardware interface 2212 takes the form 
of an application programming interface (API) for 
operating system 2214. In this way, analysis tool 2216 
may obtain data from counter 2204 and counter 2210. 
Analysis tool 2216 may take many forms, such as for 
example, Oprofile, which is a known system wide profiler 
for Linux systems. Although the examples in Figure 22 
illustrate providing an interface to an instruction unit 
and a data unit, hardware interface 2212 may be 
implemented to provide access to information from other 
units in a processor. For example, APIs may be created 
for hardware interface 2212 that allows for accessing 
information located in counters in a performance monitor 
unit, such as counter 241 and 242 in performance monitor 

unit 240 in Figure 2. 

in Figure 23, a block diagram of components used in 
autonomically modifying code in a program to allow 
selective counting or profiling of sections of code in 
accordance with a preferred embodiment of the present 
invention. In this example, profiler 2300 is a program, 
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such as tprof , that may be used to identify routines of 
high usage in a program, such as program 2302. In these 
examples, "tprof" is a timer profiler, which ships with 
the Advanced Interactive Executive (AIX) operating system 
from international Business Machines ( IBM) Corporation. 
This program takes samples, which are initiated by a 
timer. Upon expiration of a timer, tprof identifies the 
instruction executed. Tprof is a CPU profiling tool that 
can be used for system performance analysis. The tool is 
an example of an analysis tool and based on the sampling 
technique which encompasses the following steps: 
interrupt the system periodically by time or performance 
monitor counter; determine the address of the interrupted 
code along with process id (pid) and thread id (tid) ; 
record a TPROF hook in the software trace buffer; and 
return to the interrupted code. 

Alternatively, a fixed number of counts of a 
performance monitor counter may be used instead of a 
timer. This program profiles subroutines that are used 
to indicate where time is spent within a program. A 
program having usage over a certain threshold also is 
referred to as being "hot". By using information from 
profiler 2300, routines of interest, such as subroutine 
2304 in program 2302 may be identified. 

With this information, the instructions in 
subroutine 2304 may be autonomically modified by analysis 
tool 2306 to allow counting of the execution of 
subroutine 2304. Additional routines may be identified 
for modification by analysis tool 2306. For example, 
subroutine 2304 also may be identified as a routine of 
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interest with the instructions of this routine being 
modified to allow counting of the execution of subroutine 
2304. The modification of the code in these routines 
includes associating performance indicators with one or 
more instructions within each of these subroutines. 

After the instructions in these routines have been 
modified by analysis tool 2306, program 2302 is then 
executed by processor 2308. Processor 2308 executes 
program 2302 and provides counts for these routines. For 
example, the counting of instructions executed and the 
number of cycles used in executing a routine may be 
performed by processor 2308 using the mechanisms 

described above. 

With reference to Figure 24, a flowchart of a 
process for dynamically adding or associating performance 
indicators to an instruction is depicted in accordance 
with a preferred embodiment of the present invention. 
The process illustrated in Figure 24 may be implemented 
in a program, such as analysis tool 2306 in Figure 23. 
An analysis tool is a program that is used to obtain 
metrics about the execution of a program. These metrics 
may be any measurable parameter, such as execution time, 
routines executed, particular instructions executed, and 
memory locations accessed. 

The process begins by identifying instructions of 
interest using data from a profiler (step 2400) . This 
profiler may be, for example, a timer profiler found in 
AIX. An instruction from the identified instructions is 
selected for modification (step 2402). Thereafter, a 



51 

Docket No. AUS920030481US1 



performance indicator is dynamically added to the 
selected instruction (step 2404) . 

In step 2404, the instruction may be added in a 
manner such that the instructions do not need to be 
modified for execution. A performance instrumentation 
shadow memory, such as performance instrumentation shadow 
memory 1506 in Figure 15, may be employed to hold the 
performance indicators. In this situation, a register is 
set in the processor to indicate that the performance 
instrumentation shadow memory should be checked for 
performance indicators when executing instructions. 

A determination is then made as to whether 
additional identified instructions are present for 
modification (step 2406) . If additional instructions are 
present for modification, the process returns to step 
2402. Otherwise, the process terminates. 

Turning next to Figure 25, a diagram illustrating 
components used to scan pages through associating 
performance indicators with instructions in a page is 
depicted in accordance with a preferred embodiment of the 
present invention. The mechanism of the present invention 
uses performance indicators to allow instrumenting or 
modifying of instructions in a program one page at a 
time . 

in this example, program 2500 contains three pages, 
page 2502, page 2504, and page 2506. Scanning daemon 
2508 associates performance indicators with instructions 
in program 2500 one or more pages at a time. For 
example, the instructions in page 2502 may be associated 
with performance indicators by scanning daemon 2508. 
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Program 2500 is then executed by processor 2510. Data 
from the execution of program 2500 may then be collected. 
This data includes, for example, counts of events 
occurring in response to instructions in page 2502, 
counting the number of times each instruction in page 
2502 is executed, and/or identifying the number of visits 

to page 2502. 

Next, scanning daemon may remove the performance 
indicators from instructions in page 2502 and associate 
performance indicators with instructions in page 2504. 
Program 2500 is then executed again by processor 2510, 
and data from execution of this program is collected. 
Then, instructions in page 2506 may be modified in 
program 2500 executed to collect data on that page. 

in this manner, usages of routines typically not 
recorded by programs, such as a timer profiler, may be 
identified. A timer profiler may not record some usages 
of routines because interrupts may be inhibited or the 
timing of samples may cause synchronous non-random 
behavior. By modifying instructions in program 2500, 
counting a routine or other modules may be obtained in 
which the counts are unbiased and the system is 
unperturbed. In this manner, interrupt driven counting 
is avoided. Further, although the instrumenting of code 
is one page at a time, other groupings of instructions 
may be used in scanning a program, such as modules that 
form the program. For example, the grouping may be a 
single executable program, a library, a group of selected 
functions, and a group of selected pages. 
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Turning next to Figure 26, a flowchart of a process 
for adding indicators to instructions in a page is 
depicted in accordance with a preferred embodiment of the 
present invention. The process illustrated in Figure 26 
may be implemented in a program, such as scanning daemon 

2508 in Figure 25. 

First, a selection of pages is identified (step 
2600). in this example, the pages are those in the 
program that are to be scanned or instrumented. Next, a 
page within the selection of pages is selected for 
modification (step 2602). Indicators are then associated 
with all of the instructions in the selected page (step 
2604). The program is then executed (step 2606). Next, 
a determination is made as to whether all the pages with 
the selection have been scanned (step 2608) . If all of 
the pages have been scanned, the process terminates 
thereafter. However, if not all pages have been scanned, 
the next page to be scanned is selected (step 2610), with 
the process returning to step 2604 as described above. 

The process illustrated in Figure 26 shows scanned 
groupings of instructions as pages. Depending on the 
particular implementation, other types of groupings of 
instructions, such as modules that form a program, may be 
scanned or instrumented in this manner. 

A program is employed to identify a caller from a 
routine from the information found in a call stack. 
This program allows for an identification of what has 
occurred in a routine and provides a summary of what has 
occurred in a program by identifying function calls that 
have been made. This program, however, requires 
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instructions inserted in the code to obtain this 
information . 

The mechanism of the present invention allows for 
identifying calls and returns without having to perform 
special code instrumentation. In particular, the 
function of generating an interrupt on a specific set of 
instructions may be used to gather information about the 
system and applications. In these examples, instructions 
for calls and returns are associated with a performance 
indicator that generates an interrupt. 

By walking back up the call stack, a complete call 
stack can be obtained for analysis. A "stack walk" may 
also be described as a "stack unwind", and the process of 
"walking the stack" may also be described as "unwinding 
the stack." Each of these terms illustrates a different 
xaetaphor for the process. The process can be described as 
"walking" as the process must obtain and process the stack 
frames step-by-step or f rame -by- frame . The process may 
also be described as "unwinding" as the process must 
obtain and process the stack frames that point to one 
another, and these pointers and their information must be 
"unwound" through many pointer dereferences. 

The stack unwind follows the sequence of 
function/method calls at the time of an interrupt and is 
generated in response to execution of an instruction 
associated with a performance indicator. A call stack is 
an ordered list of routines plus offsets within routines, 
(i.e. modules, functions, methods, etc.) that have been 
entered during execution of a program. For example, if 
routine A calls routine B, and then routine B calls 
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routine C, while the processor is executing instructions 
in routine C, the call stack is ABC. When control returns 
from routine C back to routine B, the call stack is AB. 
For more compact presentation and ease of interpretation 
within a generated report, the names of the routines are 
presented without any information about offsets. Offsets 
could be used for more detailed analysis of the execution 
of a program, however, offsets are not considered further 
herein. 

Thus, during interrupt processing or at post- 
processing initiated by execution of an instruction 
associated with a particular performance indicator, the 
generated sample-based profile information reflects a 
sampling of call stacks, not just leaves of the possible 
call stacks, as in some program counter sampling 
techniques. A leaf is a node at the end of a branch, i.e. 
a node that has no descendants. A descendant is a child 
of a parent node, and a leaf is a node that has no 
children. 

With reference now to Figure 27, a diagram depicting 
call stack containing stack frames is depicted in 
accordance with a preferred embodiment of the present 
invention. A "stack" is a region of reserved memory in 
which a program or programs store status data, such as 
procedure and function call addresses, passed parameters, 
and sometimes local variables. A "stack frame" is a 
portion of a thread's stack that represents local storage 
(arguments, return addresses, return values, and local 
variables) for a single function invocation. Every 
active thread of execution has a portion of system memory 
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allocated for its stack space. A thread's stack consists 
of sequences of stack frames. The set of frames on a 
thread's stack represent the state of execution of that 
thread at any time. Since stack frames are typically 
interlinked (e.g., each stack frame points to the 
previous stack frame) , it is often possible to trace back 
up the sequence of stack frames and develop the "call 
stack" . A call stack represents all not-yet-completed 
function calls - in other words, it reflects the 
function invocation sequence at any point in time. 

Call stack 2700 includes information identifying the 
routine that is currently running, the routine that 
invoked it, and so on, all the way up to the main 
program. Call stack 2700 includes a number of stack 
frames 2702, 2704, 2706, and 2708. In the depicted 
example, stack frame 2702 is at the top of call stack 
2700, while stack frame 2708 is located at the bottom of 
call stack 2700. The top of the call stack is also 
referred to as the "roof. The interrupt (found in most 
operating systems) is modified to obtain the program 
counter value (pcv) of the interrupted thread, together 
with the pointer to the currently active stack frame for 
that thread. In the Intel architecture, this is 
typically represented by the contents of registers: EIP 
(program counter) and EBP (pointer to stack frame) . 

By accessing the currently active stack frame, it is 
possible to take advantage of the (typical) stack frame 
linkage convention in order to chain all of the frames 
together. Part of the standard linkage convention also 
dictates that the function return address be placed just 
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above the invoked- function ■ s stack frame, this can be 
used to ascertain the address for the invoked function. 
While this discussion employs an Intel-based 
architecture, this example is not a restriction. Most 
architectures employ linkage conventions that can be 
similarly navigated by a modified profiling interrupt 
handler . 

When an interrupt occurs, the first parameter 
acquired is the program counter value. The next value is 
the pointer to the top of the current stack frame for 
interrupted thread. In the depicted example, this value 
would point to EBP 2708a in stack frame 2708. In turn 

turn points to EBP 2704a in stack frame 2704. In turn 

• t- t-r. EBP 2702a in stack frame 2702. Within 
this EBP points to EBP z/v*a 

stack frames 2702-2708 are EIPs 2702b-2708b, which 
identify the calling routine's return address. The 
routines may be identified from these addresses. Thus, 
routines are defined by collecting all of the return 
addresses by working up or backwards through the 

Obtaining a complete call stack may be difficult in 
some circumstances, because the environment may make 
tracing difficult, such as when an application having one 
call stack makes a call to a kernel having a different 
call stack. The hardware support provided by the 
m echanism of the present invention avoids some of these 
problems. 

Turning next to Figure 28. a flowchart of a process 
for identifying events associated with call and return 
instructions in which data is collected from a 
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with a preferred embodiment of the present invention. 
The process illustrated in Figure 29 may be implemented 
in a functional unit within a processor, such as 
instruction cache 214 in Figure 2. This process is used 
to identify counts of instructions that are executed and 
to generate an interrupt when these instructions have 
occurred more than some selected number of times. 

First, a determination is made as to whether an 
execution of a selected instruction is detected (step 
2900) This determination is made by examining each 
instruction that is executed to see whether a performance 
indicator is associated with the instruction. These 
performance indicators may be associated with the 
instructions through different tools, such as compiler 
1500 in Figure 15 or analysis tool 2216 in Figure 22. 

If execution of an instruction containing a 
performance indicator is not identified, the process 
returns to step 2900 until a selected instruction is 
detected. If a selected instruction is identified as 
being executed, a counter with a set threshold is 
incremented for that selected instruction to count how 
often that particular instruction is executed (step 
2902). in these examples, each instruction identified 
for monitoring is assigned a counter. 

Next, a determination is made as to whether the set 
threshold has been reached (step 2904) . Threshold values 
are initially determined by using documented cache miss 
times, for each of the cache levels. However, increasing 
times are used to determine problems caused by cache 
interventions (accesses from other processors) . Repeated 
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Th e mechanism o £ the present invention includes employing 
an indicator that is recognized by the processor to 
enabl e counting the execution of an instruction 
associated with the indicator, various types of counting 
as described above are enabled through this mechanism. 

rLr, with the information provided through the use of 
associating indicators with particular instructs 
mechanism of the present invention also 
various types of adjustments to programs rn monitoring 
and analyzing performance of programs. Further as 
aescribed above, programs may be automatically adjusted 
co allow for monitoring of selected instructs and 
routines and modules without having to modify the 

program. . 
It is important to note that while the present 

invention has been described in the context of a fully 
functioning data processing system, those of ordinary 
sxill in the art will appreciate that the processes of 
b present invention are capable of being distributed rn 
the Lm of a computer readable medium of instructions 
and a variety of forms and that the present invention 
applies equally regardless of the particular type of 
signal bearing media actually used to carry out the 
attribution. Examples of computer readable medra 
include recordable-type media, such as a floppy drsk. 
hard dish drive, a RAM. CD-ROMs, DVD-ROMs, and 
t ransmission-type media, such as digital and analog 
co»unications lints, wired or wireless communications 
iinxs using transmission forms, such as, for example, 
raaio frequency ana light wave transmissions. The 
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computer readable media may take the form of coded 
formats that are decoded for actual use in a particular 
data processing system. 

The description of the present invention has been 
presented for purposes of illustration and description, 
and is not intended to be exhaustive or limited to the 
invention in the form disclosed. Many modifications and 
variations will be apparent to those of ordinary skill in 
the art. For example, instead of using a field in an 
instruction or in a bundle, a new instruction or 
operation code may be used to indicate that a subsequent 
instruction, or a subsequent set of instructions are 
marked instructions. Also, the architecture of a 
processor may be changed to include additional bits if 
spare fields for performance indicators are unavailable 
in the case in which it is desirable to include 
performance indicators within fields in the instructions. 
Also, although examples of events, such as execution of 
the instruction, time, such as clock or processor cycles, 
needed to execute an instruction, time to access data, 
entry into a section of code, have been given, these 
examples are not meant to limit the present invention to 
the types of events that can be counted. Any event 
relating to execution of an instruction or access to a 
memory location may be counted using the mechanisms of 
the present invention. 

The illustrative embodiments were chosen and 
described in order to best explain the principles of the 
invention, the practical application, and to enable 
others of ordinary skill in the art to understand the 
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invention for various embodiments with variou; 
modifications as are suited to the particular 
contemplated . 



